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psychological problemsr and it was hypothesized that the more 
oroblems students had, the less likely they would be to gain a __ i 
credit. louraer students were assigned scores ranging from zero to 23 ; 
dependlha upon the number of problems they exhibited* it was found 
that educationally gualified Students with low scores were 
particularly succ^jssful and ungual?, f 5 id students with high scores 
were very unlikely to gain a credit* Tti order to -attach weights to 
individual problemsr a stepwise multip^ regression was conducted 
using the 23 problems as independent variables and whether or nota 
credit was aained as the dependent variable* The^resulting variables 
was an extremely good predictor for first-year progress among younger 
students. When performance across the aae range was examined, it was 
found that younger students, with few social and psychclogical 
problems fared as well as their older counterparts and that the^ 
relatively poor progress made by younger students could partly be 
explained by the fact th^ their study ihyirotiments and personality 
characteristics tended to be less suited to distance study* However, 
i** was also shown that when numerous problems existed it was the _ 
older students who were more willing or able to overcome ttiem*_It is 
concluded tha* environmental and psycholoaical factors are at least 
as .important as_academic ability in determining student performance^ 
ardthat the model can be used to identify hiah-risk students* & 
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The paper outlines a maltf-variate model for the explanation of student 
success arid failure at the Open University of the United Kingdom. It is 
baied on the results of an evaluation study into the suitability of this 
teaching systim for young peoplcr aged under twenty-one. It is shown that 
environmental and psyatio logical factors are at least as important as 
academic ability in determining student performance. The model can be 
used to identify high-risk students and also to suggests ways in which the 
teaching system could be improved. 
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Intrdduction 

The Open University (Ouj of the United kingdom is a multi-media distance 
teaching system offering degree-level opportuhi ties to adults studying in 
their own home.^ Between 197^ and 1976 over a thousand students aged 
between eighteen and twenty were admitted to the University in order to 
determine whether the system is suitable for; students in this younger age 
groupp Woodley and Mcintosh (1980) showed that the younger students were 
much less likely to succeed with their first year studies, than were the i r 
older counterparts. - In order to discover which types of younger studeiit 
were most likely to succeed with their studies their First year progress 
was analysed ih/some detail. 

There now exists a considerable body of research into the prediction of 
success and failure in higher education and several detailed reviews are 
available (Miller (1970), Watts (1972), Astin (1975), Entwistle and Wilson 
(1977))^ Literally hundreds of predictive variables have been considered, 
the great majority falling under one of the fbllowing headings: measures 
of inteUectual ability, personality characteristics^ demographic variables 
motivation and study habi ts/ learning styles. However, in a distance 
teaching situation there are also a whole host of different variables which 
can influence student progress. These include employment and domestic 
factors^ and access to the teaching media. This paper represents an 
attempt to combine these variables to produce a mul t i-variate explanatory 
model of younger students progress at the OU, 

Early results 

In Figure 1 we show the progress made by younger students in their first 
year, broken down by previous educational qualifications and sex. We see 
that, in gCiPeral^ the higher the qualifications held the morr likely they 



were to obtain a course credit. Hc^everi except in the case of those with 
no qualif ications at alU women fared better than rrieh at each educational 
leveU / 

the obvious cdnclusibn to draw from Figure 1 would be that Oil progress is 
determined by academic ability. However, while ackncwled§ih§ that ability 
is almost certainly a significant factor, we would contend that such a 
cbnclusibn is too simplistic for a number of reasons; Firstly, an- earlier 
survey had shown that the educational qualifications held by younger 
students did not necessarily reflect their true ability due to fortuitous 
events in their schooling. Secondly, factors in their study envirbhment 
suggested that thbse with low qualifications would find 6U study n»re 
difficult regardless bf their ability. Thirdly, the fact that women fared* 
better than men regardless of qualifications^ and that many eminently well 
qualified younger students nevertheless failed tb make progress ^ demori- 
strates clearly that ability alone cannot explain the variabi.lity in ybUnger 
student perforrilance.,. 

Further analysis bf the perfbrmance of younger students was carried out 

using data from administrative fbrms, a sociblbgical quest iohnai re and a 

psychometric test battery which they had completed as they began their OU 

studies. This analysis enabled us. to identify a large humbe:r..of variables 

which were good predictors bf whether or nbt a younger student would gain 

a course credit.. However, no single variable cbUld explain why, for 

ihstarice men without the qualifications for entry to a cbhvehtibhal British 

2 

unfversity fared so badly in comparison wtth *'qual i f led'* women. Academic 
ability, as measured by the AH6 intelligence test and the vocabulary test^ 
was obviously, important but clearly bther factors were also at work. 
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Towards a mul t i-var late model 

To begin with we took twenty-three characteristics which we refer to as 
social and psychological "probiems". Some of these characteristics Such 
as high artistic ability would be regarded as positive attributes in other 
contexts but we have selected them and labelled them as "problems" because 
from the analysis referred to above they appeared to be associated with 
failure to gain a credit. ; in Table 1 we have listed these characteristics 
and ranked the sex and qualifications categories according to thei r 
possession of a given characteristic. For instance, the first row indicates 
that "unqualified" men ^c^Dtained the highest proportion of manual workers 
and "qualified" wbmenYthe lowest. It emerges from the totals given at the 
bottoS of this table that "unqualified" students were "disadvantaged" in 
many other ways apart from their s .ewhat lower ability levels. To develop 
an adequate explanatory model we must therefore adopt a mul ti-variate 
apprbach. 

Our simple hypothesis was that the more "problems" students had, the less 

likely they would be to gain a credit. Younger students were therefore given 

scores ranging from zero to twenty-three depending upon the number of 

"problems" they exhibited. This new variabi e' proved to be a powerful 

predictor of student progress. Eleven of the sixteen stSidents with fewer 

than four problems were successful but only two of the fifteen with more 

than twelve problems. In Table 2 we have used a grouped version of this 
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score as a new test factor. 



The new variable produced Significant relationships in each of the sex and 
qualifications categories. "Qualified" students with low scores were 
particularly successful and "unqualified" students with high scores were 
Very unlikely to gain a credit; The adjusted pass-rates show that ma6h 5f 
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the variabilitY in pass-rates can be accounted for by the fact that groups 
such as the "unqualified'' tended to have more ''prbbleins''; ^ 

Up aiitit now we have treated problems as if they were all equal in impor- 
tance whereas some are likely to be TOre critical than others. In order 
to attach weights to Individual problems we ran a step-wise multiple 
regression using the twenty-three probjems as independent variables, and 
whether or not a credit. was gained as the depehdeht variable. The 'B' 
coefficients fron the resulting equation were then used to produce a 
weighted problem score for each student, (The actual weights are shown 
in Figure 2. ) 

The new variable proved to be an extremely good predictor of first-year 
progress among younger students. As shown in Table 3, six but of ten 
younger students with a 'Weighted p.roblefS score'* of fifty or less gained a 
credit but only one but bf ten of-^^hose==»fctl« -score of more than fifty. 
Farthermore this pattern Was repeated in each of the sex and r:ual if ications 
categories and the adjusted pass-rates shew thatthis m^del can explain 
a great deal of variability In success rates between the different 
categbries. 

In the next stage of bur analysis we wished to examine whether those 
factors which had been found to be important in explaining younger student 
performance could also account for the variatibn in pass-rates between the 
different age-groups. In Table k we revert to the unweighted total problem 
score and compare pass-rates across the age range. 

within each age group those students with the mds^ jsrobiertis were the least 
likeiy to gain a credit; Among those with fewer than six problems the 



younger students were as successful as students aged between twenty-brie 
* arid forty. However^ among those with six or more problems, and. particu- 
larly in the case of those with nine or more problems the younger students 
fared worse than their older couriterparts. Studerits aged between fbrty- 
brie and fifty fared better Chan younger students regardless of the number 
of problems. The adjusted pass-rates indicate that the younger students* 
relatively poor performarice can partly be explained by the fact that they 
tended to have more problems. However, tne figures wbuld suggest that^ in 
the main, the youhg^p>i«*tudents were less successfal because those with 
multiple problems were less able or willing to overcome them or to adopt 
appropriate coping strategies* 

Conclusions 

!ri this paper we have shown that previbus educatibhal qualifications were 
a gobd predictor of first-year performance ambng ybunger students. The 
lower the qualifications the less chance a student had of gaining a credit. 
However, this was only partly due to the fact that those with low qaalific- 
atibris were less academically able* Progress at the OU was also related 
to factors in the study envirbriment such as ease bf access to ^tudy centres 
the attitudes of frierids, work colleagues arid employers, the ambunt bf 
preparatory study etc. and t'j certain personality characteristics. Ybunger 
students with low qualifications fared less well because they were 
''disadvantaged** not bnly in terms bf academic ability but also in terms of 
their study erivirbrimerit arid in terms of their persbnality characterl:: cI cs 
which made them less suited to 0U study. 

The multi-variate model cbUld be used to develop tools to identify "high" 
arid **lbw risk** ybunger studerits at t;ie admissions stage. However, this 
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would involve the completion and iriterpretatioh of special questionnaires 
arid tests and therefore the strerf^ths bf such models perhaps lie in the 

contribution they make to bur uhderstahding of the reasons for the success 
or failure of younger 0U students. 

When we looked at performance across the age range it was shown that 
younger students with few social and psychological "problems" fared as 
well as their older counterparts and that the relatively poor progress 
made by younger students could partly be explained by the fact that their 
study environments and personality characteristics tended to be less 
Suited tb distance study. However, It was also shown that when namerous 
problems existed it was the blder students who were more willing or able - 
to overcome them. 



Fodthbtes 

1; For a more detailed description of the Open University's teaching 
system, please consult the current edition of the following OU 
publications: The Suide for Applicants, The BA Degree Handbook, The 
Courses Handbook. 

2. Students were regarded as ''qaal if fed'' IF they held two or more A 
levels, ah Ordinary National Certificate or Diploma (ONC/D) or if they 
had previotisly entered Higher Education. 

3. When grouping "problen scores" we tried to preserve what appeared to 
be naturally occurring break-points in the data and also to ensure 
that there were reasonable numbers of students wi thin each group. 

^. Adjusted pass rates were calculated to cbntrbl for the effects of a 
given variable being differently ciistributed between the categories 
of student under consideration. The distribution of the variable 
was held constant at the level found among the most successful 
student category/ For a more detailed account refer to Woodley and 
;Mclntosh (1980). 
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Table 1 

■Rank-ordering of predictive variables within sex 
a nd qa a l if ications categorie i^ 



Male 



Qual- 
ified 



Unqual- 
i f ied 



Fema 1 e 



Qual- 
i f i ed 



Predictive variables 

a) Social 'problems' 

1 In manual occupation 

2 Not married 

3 Not possessing 1 A-level 

or equi valent 
k Not definitely aiming for 
OU degree 

5 (Juiet place for study not 
always available 
5 Problems of access to 
"broadcasts 

7 Study centre attendance 

problems 

8 Surraner school attendance 

problems 

9 Work CO 1 leagues non- 

, supportive 

10 Employer hbn-supporti ve . 

11 Friends hbn-support i ve 

12 Financial problems 

13 Insufficient preparatory 

work 

b) : Psycho 1 og i cal 'problems' 

\^ Low AH6 score 

15 Lbv/ Vocabulary score 

15 High Neuroticism score 

17 \-6m academic ability 
. (self-rated) 

18 High artistic ability 

(self- rated) 

19 High impulsiveness 

(seH^ rated) 

20 High leadership ability 

(self- rated) 

21 High mechanical ability 

(self-rated) 

22 High popularity 

(self- rated) 

23 High self-confidence 
(social) (self-rated) 
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Numbers of 1's and 2's 
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The percentage of- 



■irredlt analysed 



by number of social and psy chologic a l 'problem sl 



Qual- I Unqual- 
ified ! ificd 



Hale Female 



Hale 



Female 



Qua I- QnQual- i Qua I- Doqual- 
ified ifiea ' ifted ' If led 



WttBbT Qf _$Q€jal 
m6 p tycho log teal 
'pfoblw'' 



I 



0-5 

9 or florc. 
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! *7 
15 



78 
37 
*6* 



58 
12 



62* i 


72^ 


76* 1 
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61 
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12 


20 
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^i6* i 


15 



Si 9riificance_ level j 
of Chi -square | 
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Actual pass- rate 
Adj^ted pass- rate 
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Table k 

the percentage of stadenls-in different age groups 
who gained ^ ^redi^ ^alysed by num b er of soc Lal 
and psycho log leal 'problems' 





Age group 




Under 
21 


21-25 


26-30 


31-40 


41-58 


























Number of social 












and |>^ycho]ogi f^al 












' problems' 












0-5 


67 


68 


64 


64 


79 


6-8 


Ml 


54 


68 


70 


64 


9 or more 




38 


48 


42 


42 


■ Significance level 


^% - 
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. Not 
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of Chi-square 


Sig. 






Actual (jass-rate 


38 


53 


62 


61 


61 


Adjusted pass- rate 


47 


56 


62 


61 


64 




r 



17 



ERIC 



Figure 2 Weights used to derive weighted, problem score 



Variabls 



Weight 



Variable 



We ight 



Friends non-supportive 

High popularity (self- 
rated) 

Summer school attendance 
problems 

High artistic abil i tv 
(self- rated) ^ 

Less than one A- level 

^uiet place for. study 
not always available 

Low AH6 score 

Employer non-snpporti ve 

High mechanical ability 
(self- rated) 

Low academi c abi Hty 
(self- rated} 

High Impulsiveness 
(self-rated) 



25 
15 

14 

14 

13 

Id 

9 
8 

7 
S 
6 



Not married 

i h manual dccupatibh 

Study centre attendance 
problems 

High self-confidence 
( soc i a 1 ) ( se 1 f - r a ted ) 

Insufficient preparatory 

work 

Low vocabulary score 

High leadership abi 1 i ty 
(self-rated) 

Not definitely aiming for 
0U degree 

Work colleagues nbh- 
/ supportive 

Fihahci al problems 



6 
6 

5 

k 

2 
2 
2 



-1 



-1 



EKLC 



is 



